Statistics of Entropy Production in Linearized Stochastic System 
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We consider a wide class of linear stochastic problems driven off the equilibrium by a multiplicative asymmet- 
ric force. The force brakes detailed balance, maintained otherwise, thus producing entropy. The large deviation 
function of the entropy production in the system is calculated explicitly. The general result is illustrated using 
an example of a polymer immersed in a gradient flow and subject to thermal fluctuations. 
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The Gibbs distribution, Veq{x) ^ exp[— L/(a;)/T], de- 
scribes the probability for a system characterized by the mi- 
croscopic potential U{x) and maintained at equiUbrium at 
temperature T to be observed in the state x. In particular, 
in our model case of a polymer the elastic potential U{x) 
depends on the end-to-end position vector x. The system 
at equilibrium maintains the detailed balance, which is the 
most fundamentalprinciple of equilibrium statistical mechan- 
ics inaiii. Formally, the detailed balance means 

that the probabilities 'P{x} and 'P{x*} for a stochastic tra- 
jectory, {a;} = {x{t')\Q < t' < t} and its "conjugated twin" 
{x}* = {x*{t') =x{t-t');0 <t' < t} are related by 



in balance: 
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Asymmetric external force breaks down the detailed balance. 
For example, a shearing flow forces the polymer to tumble and 
results in steady entropy production QQ]. In general, config- 
urational entropy is naturally defined as a mismatch between 
the left and right hand sides of Eq. 



off ballance: 5 = In 
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For a wide class of thermalized systems, driven out of equi- 
librium by external non-conservative forces the entropy has 
also a standard thermodynamic interpretation: It determines 
the total heat produced by the system over time t. In the off- 
detailed balance case entropy is a fluctuating function of the 
entire configurational trajectory {x}. Therefore, in the statis- 
tically steady non-equilibrium case fluctuations occur on the 
top of a steady mean growth of the entropy and one can ar- 
gue that at sufficiently large observation time the distribution 
function of the produced entropy S takes a large deviation 
form [8, ft]: 



V{S\t) - exp [-t£{ST/t)/T] 



(3) 



where r is the typical coiTelation (turnover) time of the sys- 
tem and C{uj) is referred to as the large deviation function. 
Description of the large deviation function for a truly non- 
equilibrium problem is a difficult task, and only a few suc- 
cessful results have been reported so far ifioll . To clarify the 



difficulty let us also mention that a simpler problem of find- 
ing an off-detailed balance analog of the Gibbs distribution, 
posed in a classical work of Onsager lTll|. has been solved 
for a few examples only. ( See il2l Il3l 11411 for discussion of 
some difficulties, progress and results achieved on this thorny 
path.) It is worth to note that the large deviation function of 
entropy production was computed and verified experimentally 
for a number of other physical situation, e.g. optically dragged 
Brownian particles, electrical circuits and forced harmonic os- 
cillators fl5]. Although these works are ideologically simi- 
lar, technically they study different non-equilibrium systems, 
which are either non-steady or do not have the detailed bal- 
ance broken. 

In this letter we present a solution of this challenging task 
for a wide class of linear problems driven by multiplicative 
asymmetric "force" and also connected to a Langevin reser- 
voir Such problems arise whenever a statistically steady 
non-equilibrium state is externally driven by space ix)- 
dependent non-conservative external forces. In this context 
our main physical example is of a Hookean polymer stretched 
and sheared by a mild constant external flow. For this linear 
non-equilibrium setting we report an explicit expression for 
the large deviation function of the entropy production. For 
the most general case our result is given as a solution of a 
well-defined system of algebraic equations or, alternatively, 
in terms of an one-dimensional integral Eq. ( fTSI l. For the 
linear polymer in a constant gradient flow the large deviation 
function is presented in terms of elementary functions, see 
e.g. Eq. (flJl i. The most important features of the results for 
the large deviation function derived in this Letter are: 

• 1 The steady state solutions are consistent with the fluctua- 
tion theorem 



C{lu) — L{—u}) = —uj. 



(4) 



• 2 The large deviation function is found to be very different 
from the Gaussian shape. Extreme tails of the entropy PDF 
are exponential, that are the steepest tails allowed by the large 
deviation form (|3]l. 

• 3 One observes reduction in the number of parameters affect- 
ing the shape of the large deviation function. For example, the 
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large deviation function is completely insensitive to the sym- 
metric part of the velocity gradient in the case of the linear 
polymer immersed in a 2d flow. 

The letter is organized as follows. After introducing the 
polymer in a flow example, we focus on this model calcu- 
lating the entropy production and defining the corresponding 
generating function. We further derive a Fokker-Planck equa- 
tion for the generating function and solve it using a Gaussian 
ansatz for the related eigenvalue problem. This results in a 
system of matrix algebraic equations that define the principle 
part of the longest-time asymptotic of the generating function. 
The solution for the most general case of two-dimensional 
flow is expressed in terms of elementary functions. This ex- 
plicit description is also extended to a special three dimen- 
sional case. Then, we switch to a general linear model with 
a constant multiplicative force. The general model, defined 
in Eq. (fl4l l. is analyzed using a direct solution of the linear 
stochastic equations followed by averaging the resulting ex- 
pression for the generating function over the Langevin noise. 
This method is complementary to the aforementioned Fokker- 
Planck approach. The final result for the large time asymtp- 
totic of the generating function is presented in terms of the 
one-dimensional integral over frequency. 

The polymer's end-to-end vector, Xi satisfies a stochastic 
equation of motion lfl9ll 

Xi - a^jXj = -dx,U{x) + ^i, (5) 

where the traceless matrix a describes the local value of the 
velocity gradient in the generic incompressible flow (i = 
I,-- - ,d). The smoothness of velocity on the scale of an 
even very extended polymer is justified by many experimen- 
tal observations, see e.g. fl^. Eq.© describes the balance 
of forces: the second term on the Ihs represents the poly- 
mer deformation by the velocity field. The two terms on 
the rhs of Eq.© account for the polymer elasticity and for 
the Langevin thermal noise. In this Letter we consider a de- 
terministic constant gradient flow, a = const and focus on 
the case of a relatively weak a and linear model of Hookean 
polymer, Uh{x) — x'^/{2t). Yet, we will also discuss the 
other extreme of a stretched nonUnear polymer in a strong 
gradient flow. The Langevin term in Eq.® is modeled by 
the zero mean white Gaussian noise with {£,i{t)£,j{t')) = 
2T6{t~t')6^j. 

According to Eq. (|5]l the probability for a stochastic poly- 
mer trajectory in the configuration space is given by 

V{x} - exp dt' {x-ax + d^U{x)f /(4T)^ , 

with the entropy production (|2]l along the path {a;} (see e.g. 
S for details) 

S= f dt'x'^it') ((7"'3 - ct'^") x^{t')/{2T) + (6) 
Jo 

where the longest-time t/r ^ 1 statistics of S is naturally 
described within 0{t/T). 



The Fokker-Planck technique is applied via relating the 
large deviation function to its generating function defined by 

(exp(-(75))^. (7) 

Utilizing the large deviation asymptotic Q we can reformu- 
late averaging over the Langevin noise in Eq. (|7]i in terms of 
integration over iS and further evaluate the integral using the 
saddle-point approximation (justified for the asymptotically 
long time). This establishes the following Legendre transform 
relation between the generating and the large deviation func- 
tions: 

^ exp (- {C{LOq) ~ LOqC'iUq)) t / t) , -q = /l'^). (8) 

Substituting Eqs. (|6]l into the definition (|7]l followed by aver- 
aging over the stochastic dynamics (|5]l we arrive at the Fokker- 
Planck equation: 

dtZq = L^Zq, (9) 

Lq = -V" - d:,cU{yC)) + TV^V", (10) 

V" = a" + q{cj - &+)°'^x^/{2T), 

where the "gauge" term "elongates" the derivatives in a stan- 
dard way. Assuming that the operator Lq has a discrete spec- 
trum, the large time asymptotics of Zg is completely domi- 
nated by the ground state of Lg. Therefore, the large devia- 
tion function is fully described by its ground-state eigen-value 
and, specifically, its dependence on q. 

Here we consider the case when velocity gradient is rela- 
tively weak compared to the elastic force (or when stretch- 
ing components in a are zero) so that the steady state is 
achieved in the regime when elasticity in Eq.lfTOll is linear, 
U{x.) = x'^/{2t) (the so-called coiled, rather then stretched, 
state.) The spectral problem (|9]l in the case of Hookean elas- 
ticity is of an "integrable" type and is similar to a single- 
particle quantum mechanics in a constant magnetic field, 
when the ground-state eigen-function is Gaussian. There- 
fore, one looks for the solution of Eq. (|9]l in a form Zg = 
exp{—Xgt) exp[—XiBg^Xj/{2T)], with B being ad x d sym- 
metric matrix. Substituting the Gaussian ansatz into Eq. ^ 
we derive the following eigen-value relations for Bg and A^: 

Xg^tr(^i3g+a-i/Ty M + M+ = 0, (11) 
M= {Bg + q{a-a+)/2^(a-i/T + Bg-q{a-a+)l2^ , 

that correspond to x^ exp(...) and exp(...) terms, respectively. 
Eqs. (fTTT i are generic, i.e. valid for the full formulation given 
by Eqs.dlllOli; the Aq = and the q = version of Eqs. (II 11 1 
defines the steady distribution function for the end-to-end 
polymer length x (see, e.g. [ 14]). 

For the 2x2 traceless velocity gradient matrix an = 
— (T22 = a and (Ji2 = 6 + c, (721 = b — c one derives from 
Eq. (HB 

A, = (v/l + 4<z(l-g)c2T2-l) T-\ (12) 
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where the generating function and the eigenvalue of the 
ground state are well defined only within a finite interval, 
q e [q-;q+], where q± = 1/2 ± ^1/4- l/id^r^). No- 
tice that the eigen-value given by Eq. ( fT2] i does not de- 
pend on the symmetric part of a, even though the resulting Bg 
function does depend explicitly on both symmetric and anti- 
symmetric components. Formally this reflects the invariance 
of the Fokker-Planck operator with respect to a family of iso- 
spectral transformations that keep the spectra (or at least its 
ground state) invariant. We do not know however a physically 
intuitive explanation for this remarkable symmetry/reduction 
in the model. A similar and equally surprising phenomenon 
of reduction in the degrees-of-freedom number that control 
the large deviation function of a current has been recently 
reported for a different non-equilibrium system that models 
a contact between two thermostats kept at different tempera- 
tures [10]. Combining Eqs. ( 18112b leads to 

Ciiu) = v/(l + cV2)(4c2t2 +u;^)-1- uj/2. (13) 

Note that, first, C{uj) satisfies the fluctuation theorem (|4]l; and, 
second, the asymptotics of C{u!) at \uj\ ^ ct are both lin- 
ear in uj, making the extreme deviation asymptotics of the 
entire distribution function of S exponential and time inde- 
pendent. Tracking the origin of the exponential tails back 
to a special form of the generating function (fT2l) . one finds 
that these extreme asymptotics correspond to the square root 
singularity of Xq at q±. Time-independence of the 7'(S'|t) 
asymptotics means that typical trajectories contributing the 
PDF tail are correlated at some finite times, so that the obser- 
vational time t increase does not change corresponding prob- 
abilities. Figure [T] shows the large deviation function given 
by Eq. il3[ verified versus Brownian dynamics simulations. 
In the case of a d = 3 gradient flow the algebraic system 
of Eqs. ( fTTT ) is too complicated to allow a solution in terms 
of elementary functions for an arbitrary form of the velocity 
gradient matrix a. Thus we mention only a special exam- 
ple of a 3d flow with the following nonzero elements of (t: 
cii = — ai, o'22 = oi + a2, 0-33 = —02, 0-13 = c, 0-31 = — c. 
In this case the generating function and the large deviation 
function is given by Eqs. ST3[ modified according to the fol- 
lowing simple renormalization of r t/|1 + ar| (and uj 
respectively). 

An alternative derivation of the large deviation function 
starts with considering a general linear problem 

Xi = ^ijXj + Tij^j, (14) 

where $ and T are arbitrary constant matrices. Eq. (fl4l i de- 
scribes linear stochastic dynamics around a fixed point, that 
can be stable or unstable. We discuss here a truly non- 
equilibrium (off-detailed balance) steady state maintained if 
the fluctuations do not exceed a threshold so that nonlinear ef- 
fects can be ignored (see [14] and references therein). A flux 
state observed in diffusive system [22] is a popular example 
that involves an infinite-dimensional configurational variable 
X. Many examples of the off-detailed balance steady systems. 




w, entropy production rate 



FIG. 1: Large deviation function in d = 2 for three values of the 
governing parameter cr = 1.; 2.; 4. (red;green;blue). 

e.g. vesicles or red-blood cells in external flows f23\ and 
macromolecular biological devices, such as enzyme motors 
H^ . come from biology and soft-matter physics. Obviously, 
the T = 1 version of Eq. (fT4l i describes the aforemention two- 
beads Hookean polymer model as well, however it is worth 
mentioning that the full version of Eq. ( fT4l l also appears nat- 
urally in a more general polymer context, where the T 7^ 1 
case models hydrodynamic interactions between the different 
parts of the polymer chain |il9([ . Eq. (fT4l) also describes fluctu- 
ations around a stretched state above the coil-stretch transition 
[25, 26, 27] in a strong gradient flow [28]. 

According to Eq. (|2]i the entropy production in the system 
described by Eq. (Qll is given by S = dt'x+{t'){k^ - 

4>+K)x{t')/{2T), where K = (^tt+) . To discuss dy- 
namics at large but finite time t it is convenient to invoke a 
discrete (a-la Matsubara) frequency representation 

x{t') = ^ (cfe exp(iwfci') + cl exp{~iujkt')) / Vi, 

k 

Zq = y"npCfeI?c*exp|^-^c[.A5K)cfc/(2T)^ ,(15) 

Aq{uj) = u?k + $+M + - 2q){k^ - ^^k), 

where ujk = 27rfc/t, k — 1,2,.... Straightfor- 
ward Gaussian integration in Eq. (flSl l yields: Xgt — 
^j^^ log(dct Ag(a;fc)/ dct Ao^ojk))- In the t — > 00 Hmit one 
replaces summation over k by integration and arrives at 

which is the most general long-time asymptotic result reported 
in this letter It is straightforward to verify that in the spe- 
cial case of linear polymer advected by d = 2 gradient flow, 
$ = (J — 1/r, and Langevin driving, T = 1, the integral rep- 
resentation ( fTSI l for Xq turns into Eq. (fTZt derived earlier using 
the spectral method. 
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Note that Eq. ( fTSI ) also suggests a convenient way to deter- 
mine the values of q± for a general linear system (fl4] i. One 
finds that is a minimal positive value of q for which a so- 
lution of the equation dctyl^(cij) = does exist. The value 
of a; = 07* which solves this equation is related to the charac- 
teristic time-scale of an optimal fluctuation which controls the 
exponential tail of the entropy PDF. For the two-dimensional 
polymer problem this leads to the following explicit expres- 
sion for cj* = \/\ + — a? — iP- / T. The limit of cj* ^ 
corresponds to the coil-stretch transition. 

We conclude compiling an incomplete list of future chal- 
lenges related to the approach and results reported in this Let- 
ter. First, our analysis of the entropy production in a polymer 
system extends to the case of chaotic flows, e.g. realized in 
the recently discovered elastic turbulence 12 ill . Of a particular 
interest here is to check sensitivity of the large deviation func- 
tion to the coil-stretch transition observed in the chaotic prob- 
lem 1 25I 26 , 27 1 . Second, introducing a finite time protocol for 
a controlled parameter (e.g. shear in the polymer solution ex- 
periments) one may be interested to go beyond the analysis of 
the stationary problem, in particular discussing an off-detailed 
balance version of the Jarzynski relation 
This may also help to reconstruct (experimentally or numer- 
ically) the non-equilibrium steady-state landscape that would 
be akin to experiments currently developed for the systems 
that do not violate the detailed balance, see e.g. i32] . Newly 
developed experimental techniques that allow to track poly- 
mers in regular fs?] and chaotic 1 34] flows may be very useful 
for such applications. Finally, entropy production is closely 
related to the flux over spatial scales in the Kolmogorov-like 
cascade solutions of turbulence [35]. Studying fluctuations 
of the entropy production in turbulence by experimental, nu- 
merical and theoretical means may have a tremendous impact 
on understanding of this most challenging problem in non- 
equilibrium physics. 
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